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instructional systeas design^ed to be adaptive to the individual 
learner's characteristics are examined* Ih^ necessity of . pretesting 
students before instruction is questioned* According to the author^ 
both the necessity for and the content^of the Individually Prescribed 
"Instruction (IPI) type of pretest should be lore carefully exaiined. 
ehile the diagnosis of errors is viewed positively^ the ^n^ed to 
prescribe specific instructipn for every type of error is doubted^ 
The importance of analyzing the psychological, structure of* a^pecifc 
course, thereby deteraining the sequence of tasks ^necessary -in order 
to facilitate later learning is stressed* Examples of various types 
of placement and prescriptive proeedures, including Individually 
Prescribed Instruction and adaptive testing are presented* 
(Author/H?) . ' , . 
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^ . . , - ABSTRACT 

' * . Assessing . Students for Prescriptive 

and 'Placement Purposes ' 

^ ' ' * - Antliony J. Nitko - 

^ ' ; • UniyeijBity of Pittsburgh 

This' paper examines the use of placement and diagnostic tests in systems 
of instructl'on designed to be adaptive to^ the characteristics of learners. The 
procedure oi always pretesting before instruction is called into* question. It 
N> is argued that both the necessity ajid the content .of the IPI -*type of pretest 
should be more carefully examined before 'this pretesting paradigm is ,widely 
adopted. "Diagnosing errors" is. viewed positively, but the necessity of pre- 
scrtbiiYg specific 'instruction foj^ every type of error is questioned. Examples 
of^a vafie^ of typ^s of placement and- prescriptive assessment procedures are 
given. The importance of analy2:|ng the -instructional context and the kinds 
pf* instructional decisions ta be made is stressed. 
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Lfet's assume that an individualized course of instruction has been 

« ■ ■ ■ 

designed^ and that it has the following characteristics: 

."^^ terminal objectives, and goals of the course' have been 

specified, Fiarther, these goals have been trans latett into 

defined domains of tasks, so that the student's performance 

dn the. tasks will form the basis for inferring that the 
• J ' • ^ ^ ' > 

^ student has- attained the course^ goals , 

* 2, A sequence of intermediate leaini^g objectives that leads 

/ ^ to the attlinment of the terminal- outcomes has been ''arranged. 

Various alternative instructional procedures Kavj^sfceen developed** 

for eath of these intermediate and ten^al instructional goa^ls. 

Now consider hoij- students mi|^t most efficiently make their w-ay- 



throu^ stich a course. -Where should each begin? 'Wh^ instruction^ 

• •■ ■ ■ \- - 

procedure^ should each follow? How will students know when^^they are 

finished? The^e three questions correspond to decisions about .placement^ , 

diagnosis, and attainment (Glaser and Nitko, 1971), (See Figures l^d 2^.)^^ 

A placement xiecision answej?s the ques'tion, "Where in the instructic^- 

al sequence should the learner start in order to avoid repeating^ lin-^ 

* <j » 

necessarily what is already kno\m and injt)rder to encounter readily . ' 

attainable new goals?" The tests that give the information needed /'to i\ 

^Presented at the Sixty- first Annual Education Conferente., "Evaluation 
^ In. thS Schools", Iowa City, Iowa, December 7-8, 1976, 



make this decision must be .derived from an analysis of the psychological 
structure of the specific course. Discovering the psycl^ological struc- 
ture of the course means to'f^d the processes of transfer and general- 
ization that make it possible to order behaviors in a sequence of pre^ 
requisite tasks so, that competence in an earlier task in the sequence 
facilitates the learning of later tasks in ^e sequence (Glaser an^ 
Nitko, 1971, p. 636). Tasks can be operationally defined as dom^ns 
of test items. * • 1 

> Placing a student in a curriculum does not necessaifily specify 

"the methods of instruction that should be uied with a j^ticular student 
Tests that give informatiolf about the nature of the instruction' to be 
tised might be called diagnostic tests . ^ Diagnostic decisions answer 
the question, "What learning activities will best adapt to this studenj.' 
individual requirements and thus maximize his attainment of the chosen 
goal?" This distinction between placement testing and diagnostic 
testing is not conventional. Customaiy diagnostic tests involve both 
placement and diagnosis. ^ 

The art of distinjct diagnostic testing is not yet well developed. 
TVfo directions have been atten5)ted. One direction is clpsely related 

'to aptitude-treatment-intera'ction research {see, e.g., Cronbach and Snow 

1969; Glaser, Glaser and Nitko, 1971). This line of research 

seeks to discover pupil chalracteristics that interact with methods of 

* 

instruction in such a way that it would be possil>le to optilhally assign 
.different pupils to different methods of instruction to- learn the same 
thing. No tests now ejcKt ^at accomplish this purpose of differrrtial 



assignment to learning school subject;? in a way that is psychometrically 

"ifikcceptable to aptitude-treatment-interactioh researchers. 

'A second direction for di agios tic testing involves fine-grain 

analysis of .an individuals pupdl's performance domain. What micjroscopic 

prerequisite skills are st^onLg or weak? What misinformation or inappro- 

priate associations may intexfei^ with cei:tain activities? Tests can . 

be designed to answer qu^s^tibns such as these. 

' ' ' < ■• 

When instruction has been completed, interest centers around whether 

the studjenf has beamed the terminal objectives. Verbal statements • ^ * . 

of terminal objectives usually in5)ly that an individual ou^t to be 

able to perform quite a large nunier of tasks. This is particularly 

true when generalization and transfer of ^learning are of primary impor- 

tance. decisions that center, around whether^, t^rmij/al objectives have 

Seen. learned can be called attainment decisions. 



^ Example of ^testing and Decision-Making^ 



Having, sketched out some of the'^^b as it .decisions to be made in in- 
struction, let US: consider an illustration of How testing and decision- \ 
making have been integrated. ^ The' example comes from the Individually 
Prescrijjed Instruction (IPI) Project's elementary matheii\atics curriculum 
(Lindvall and Bolvin, 1^67). * ^ 

/ Figure 3 schematically reprfesehts the IPI .mathematics curriculum., 
The ^content of this curriculuior area has bfeeil broken down into 10 topics 
whidji are roughly in a prerequisite, order ' (from top to bottom in the 
figure). 'Further, each topic can be leariied at different levels of 
complexity. These ar^ also jin .a roU|gh prerequisite order , (from Level A 

^- , . ■ ■ ■ 



through Level G in the figure). ^_^ch cell in the grid represents 
several ins tructioilal ^objectives and is called a tmit-of instruction.;^ ' 
Inie .inset' shows , (hypothetical ly 5 how a short sequence of objectives 
might be ordered in a learning hierarchy for one unit/ Each box in* * 

' - ■ ' . - ' . • ; ^ .■' ' 

the hierarchy represents one objective. Usually, tlie hierarchy leads 
to a few terminal objectives (boxes "I" and "J*'^in the inset). Each 
usually, draws on p^requisites from earlier topics and lower levels. • 
(These ar§ shown below the dotted line in , the inset.) 

Table 1 gives examples of some of t3ie kinds of ^pjacement, diag- 
nostic, and af^ainment information that would Be useful for making 
instructional jdecisions in 'the IPX curriculum. 

Figure 4 shows a flow chart pf how testing and instruction 
blend together to giiide the flow and content, of instruction for e'^ch 
individual student. This system is not as elaborate as the system of 
placement, diagnosis, and attainment testing pifeviously de3cribed, 
however. ' i • ^ . 

. Placement Testing ^ ' ' ' ■ / , 

Let us *consider the problem of how to' place pupils in a curriculum 
sec^uence like that shown earlier in Figure. 3. ^ To answer the. question 
"Where in the instruction-al sequence should this pupil begin?'*' tK^ 
decision-maker* would need information about Jiow well the student had 
maa-tered each topic an4 wKere within a unit the student should begin 
learning. " . ^ . 

Thds is accomplished 3^n the IPI procedure by two-stage testing'. 
(Cox and Bos^toh, 1967-). The first stage test is ^broad-ranged over the 



entire curriculum, These test results are* used to place a st.udent at 
-ax-xDjit^ii each topic ox-'cbntent area. This first-sta^e would provide 
a profile for the student like the one shown in Figure 5'. This^pro- 



file Jhows', for example, that the student could begin studying in the 
unit at the DrLevel of division* . ^ ' , * 

"The second-statgd test is narrow-ranged and tests only the domain 

7 ■ • ' ■ ' , • * • •• 

of behaviors iuylied by a single unit. In this , exanple, the second- 
stage test Would test the content of D-Level division. The results 
of such second-spage test ^ould be used to place a student at a 
particular objective within a unit. The first-stage^ test would need 
to-be administered only once, at th.e beginning of the course of study, 
/(^^ter completing instruction on the first unit of stud/, here it is D- 
di vision,^ the student would be given* the s'ecojid-stage^test for the next 
sequ^ntial^ unit of study (D-Fractions) -^In this way, the^^tuden^ would • 
be placed at' each^^uccessive 'unit in the curriculum. Figure- 6 . * • 
shows what a completed second stage placement profile might look like. 

The ^cond-stage test is called a pretest in the IPX testing scheme. 
This pretest requires a student to be tested pn all of t/ie objectives 
in a !uni,t in ordeij to make a 'placement decision. Since a single item 
provides an unreliable 'basis on which to ^ake a' placement de n with - 
respect to an objectiv^, the pretest contains several subtests. Each subtest 
covers one objective with lapproximately 8 to 10 test items. If a unit ^ 
of instruction had 15 objectives; for example, .a student 'would have* to 
take 15 subtests (or approximately 15 x 8 = 120 items) before a place- 
roent decision could be made^. Suc^ a testing scheme is^non-adaptive 



6 



and time -consuming, (It should^be noted, however, that the' size of a 
unit of instruction is arbitrary and based on considerations, such as 
stiident moitivation and practical matters, such as the amount of.^vailabjl 
instructional time.) . * , * 

In an Effort to' better, adapt placemefnt^testing to the individual 
learner; Ferguson (1970) and others, (Ferguson and Hsu,- 1971; Hsu and 
Carlson, 1972) have pxpldred 'the use of the computer as a test admini- 
strator and decision-miker. Each student would take second-stage place- 

■ 1 ^ ■ '■ ^ ^ 

ment tests sitting at '^iv computer terminal. The trick, h'ere is to make 

a decision about every objective in the hierarchy of the unitMnd obtain 

' • A - . ' - 

a profile like the one -shown in Figure 6^, but to obtain this profile 

without actually testing eveiy objective. Their procedure also allows f 

" the completer to decide how many test itelns to administer . to each chi^d 

for any particular objective, to be tested. For example, some children ' 

may need to take only four items ^before a reliable decision could be 

made, while other children may need to be ^administered as many as 20 

items, before the same type of decision o^uld be made. 

4 t • 

* When placement testing in this way, a set pf decision rules is 

-devised* that coiii>ines th*e capabilities of the coiirouter with both 
. Statistical logic and subject-matter logic. ^ This allows a dynamic ' 
process to occur to decide what is to be tested and how ^extensively 
*it is to be tested. ' Thi^ procedure bre'ak^ away from the ^traditional 
"test now-; decide latex'* schemes that have received recent criticism 
(e.g.,^reen, 1969). 




As an illustT*ation consider the hierarchy sketched 
If tHe objectives can be organized, into a hierarchy, the psythological* 
structure can be employed as part o^the decision-making* procedure , 
This consideration rea^ills ip what can be called a branding rule- -that 
is, a rule jptogrammed into the computer for det ermining tjie next objec- 
tive to be tested, Choicp of the next objeptive on which a student 



is tb ^/ 



tested depiends on whether the student was declared a master 



or a nqa-master on* the last objective and on the* student's response \ 
^ , 1 ' ; • — ^ • \ 

pattern that led to. the decision* ^ . |^ 

. ' • 1 

For e^^^mple, consider FjLgure 8, The testing began on an ob- 
jective in the /taiddle of the h^ierarchy. If a stia^ent is declared a 
master on this objective, the student is assumed to have also mastered 
all of the objectives below this place in the hierarchy, IVhich of the 
objectives above this point the student h^^ mastered would need to* be , * 

determined. If this student had a Teal hidi score on this test, he 

; ' , ' ^ . -I 

could be called a *Tu^ master'' and branched all the way to the top of ' ^ 

^ >^the hierarcfliy for testing next. On the other hand^ a student having 

a lower passing score might be called a ]^\m master" and branched for 

testing next some where half way between the middle and the top of th^^ 

hierarchy. Similar branching patterns coy^^d be applied >to "low" 

."high" non-masters. A few applications of the#e branching rules would 
♦ 

^locate students quickly and efficiently in the hierarchy afid would not ^ 
require them to be tested on everything whether they needed it or not 
before a placement decision could be made, • * ^ 

' ^ • ■ V - 
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•It should be noted that in ^der to' use the computer to perform' 
la^^ge-scale testing for an entire curriculum, it .is necessary to have 
the conputer actually generate the test items. Large-scarley practical^ 4 
programs of this kind have not yet been developed and evidence concerning 
the appropriateness of the procedure needs to be provided before it 

can be strongly^ recomntended. For exBsagle^ if a unit of instruction 

^ * I ' ♦ " 

has only a few objectives then a computer- testing scheme is more 

elab6rate than needed; Also,^f a unit cannot be organized -into 

a neat Gagn^-type of hierarchy such as that which has been described 

here, then branching rules capnot be applied. 

DiagTfgstic Testing . , \ - . , 

t ' \ 

In diagnostic testing we seek to determine the kind or nature ,of 

^ the. instruction tl>at we oug^it to^give to the learner in order to facil- 
itate learning.. Of the two methods of testing described earlier--apti- 
tude-treatment-interaction and 'analysis of an individual's pejltformance 
domain — only the latter will be discussed here. ^ * ^ f 

The practical problem is thisT Sometimes the pre-arranged instruc- 
ijional materials ^in an instructional program, for'Whjy^ a system of ^ 

^lacemeht<f.and attainpnt tests hasten designed already^ do ngt 
effectively teach an- individual student. This student n^eds a special 
.prescripti^ based on available alternative. materials . One basic piece 

of information th,at is easily overlool^ed in classroom situations is a - 

r ^ _ ' . • . 

formal cataloguin-g of available alternative materials for instruction. 'It 
is of no use to atten^)! to -develop a prescription for learning* a gart- 
Icular arithmetic eoncept, for example, by using manipulative , exercises 
if such exercises could not be made available. 
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An example of a very specific procedure for provjiding information 
conceding what types of learning materials are available for 'teaching 
each ins t national objective in a unit of study in a mathematics pro- 
gram is shown in Table 2. , Ihis form links test information with 
instructional resources and c'ah be used as a/prescription form. It 
can be seen^/^at space is provided for the pretest or placement test 
score on each of five objectives (A, B, C, D, and^ E) in this unit. , 
This is followed by a listing of lesson materials available for use 

in stud)?ijig each objectiv^.^ For exanjple, there are three seCs of mani- 

> _ • - 

pulative lessons (manip.)> one game, and one workbook available for 

Objective .A. Also, the form provides space "for indicating which mater- 

/ * ' . ' ^ , 

ials a pupil is to use, when, each • less pn is completed, and a space 

for recording attainment^ test result's for 'ead> objective. This form, 
of course, would not Tiav^^B^li cat ions to programs that are not struc- 
tured or for which the-^liatet^ls listed are not available in the class- 
room. ^ • A . ^ • , C 



fii^, a 



It sho&ld be. noted also that with such a f orm', ' a 'T;^flHher or a 
school system could build-up^ it \large data-b^e concerning which types 
of instructional materials worked'best with specific kinds of s'^tudents. 
,Sudi information mi"feht.-then be recorded in a tedcher's ''clinical hand- 
l?ook" that could 'be generally availa})le for reference. 

One type of diagnostic testing has^^en used in a computer-assisted 
testing project at the Learning Research ^^^^>f>^lopment Center in the. \ 
area- of elementary school arithmetic (Hsu ^d Car Is^^w; 1972) . Invthis 
project feadh single instructional obje9^ive was broken down int-o finer- 



gra%e^ ciusters of tasks (items). Each cluster of items consisteti 
of very highly similar types of^items so that each item within a 
cluster of items ' teijded to'^licit a particular type ^ of error if not ' 
answered correctly. For example, if an objective was "Multiply a 
two-oigit ilujrib^r by another two-digit number u&ing a multiplication * 

algorithm'', then this would imply 8,100 problems. Aspects of these 
problems such as 5;arrying--<J!r noncdri^ing,*how large the carry, the 
place from which the cairry occurred, or the appearance <if zero in 
the factors, all could serve to define specific clusters of items 
Within specific. c His t^rs, common types pf errors might appear. Three 
of the many type^ ^6f cliistters' that could.be formed fpr this example 
air^shown in Table ^. * ^ * ^ ^' . . 

This type o-^ diagnostic testing has been integrated into a * 
^ ft * ' 

computer- assiS ted 'placeinent testing scheme like the one mentioned 

^earlier (Hsu .and'Garlson, 1972). When* this is done, !m4 if an 
abjective is not mastered, the computer can print out /a desicription 

.of the clusters of items with which the student ha<J difficyl^y as 
well. as the^tudenX^s score on the^/^objective. Using procedures 
wKereby each teadier could have access to a handbook that listed 
instructional materials and/or procedures that have been, found help- 
ful to teach pupils tp overcome these errors, the teacher would 
be* in a pos^ition to taijor instruction to the individual learner. - 
In a.aoE^ex computer-assisted testing program,- .the teachers'* 
handbook could also be stored in the computer's memory and .after the 
pupil is ^H^jkd,' the computer could alsp prii^t out the instructional 



options available to the teactter and learner. An exaii^le of,what>sich 
a print out'ini^t look «iike is shown in Figure 9. • 

' But one does nor heed 1:o have a^con^juter administer and score a 

.lest in otder to obtaiii this type of diagnosti*c information. In ^Florid 
Dlade County Public School System^ multiple ciic^ce tests*' were developed 
(Nes^it, 1966) .5^* Each foil of the nrultiple'-€hoice items were based'on 

^'common-errors students have .made in the. past. Each- of ^these error- 
types were- identified for the teacher in a j^yP® of diagrtostic error 
catalogue and reme<iial -activities that othetr teachers h-ad found helpful 
were also listed. Figure 10 illustrates fhis^procedurp. Cataloguing 
types of errors and the learning' activities that have been effective » 
to remediate these errors is one way that all te^tchers might have 
access to the successful clinical presciaptions of the master teadier.* 

;Further refinements of this type of fi^^^ained analysis of a 
pupil's behavior can be made either with the conputer (Binstock, Pingel 
and Hsu; 1975) or 1^ the t^Acher. Qne of these refinements is to exam- 
ine the process'by which students who are having difficulty respojii to 

.tasks. Each step of the solution to an arithmetic prob^S*j|ri can be 
examined an'd the student can be asked what the response at that' step 
should be. If a human present, the student can be asked why he or 
she made the response; Oftentimes, these interviews with stvfdenfs re- 
veal mistaken conceptions held by the student, that would haVe not other 
wise have been identified. ! . 
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Necessary and Sufficient* • . . ' 

^ At tliis point we mi^t ask, ''Is all this placement and diag- 
nosti(> testing nec"essary? And, is it suffiqiient? That is, do we need 
other testing?" 

First gf'all, whether one needs th% type of placement testing'pre- 
viously described depends on the instructional program available and of 
the copsequences of testing or not testing. If the instructional sequence 
is not ordered in at least a roigji prerequisite order and if the ins true- 
tional sequence cannot accomodate a pupil who, say, has leame^^half of 
the coOrse content but not all of it, then placement testing cannot be 
very useful. Even if we hadi placement information we could not use it if 
the instructional system does not accommodate individual differences in , 
competence. Further, even in circumstances where individual differences 
can be ^ac^mmbdated, the protest apprciach'6f IPI Mathematics mi^t 'be 
wasteful of pupil time'. Let's briefly examine this. " 

Rfecail that in IPI Mathematics the-pupi^l^^ given a pretest on ^' 
each in^t.ructioT^l. linit of the curriculum (see Figure 4)V Every time a 
pupil took a ^re-test, the pupil was tested on every objective in*l>he unit. 
Perhaps there were from 60 to 100 items on this pre-test. We have to ask^ 
whether^ this much testing is really ^eces'sar^ and useful. For example, 
it may be that a th^ld takes two or tXre^yclas^^ to complete such 

a pre-test and after /completing the test the child would ne^d three or foyr 
more class periods of instruction* Total pre-testing time p?us i-nstr^c^^ioi?^ 
time njay be five to seven class peiiods.. 1% mi^t be entirely more effi- 
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♦Grateful acknowledgement \s made to Dr. Isabel Beck of the Learning 
Research' and Development Center, University of Pittsburjji, forproviding 
infprmatior) to me on the Nev Primstiy Grades Reading Syst)5m and'ror stimu- 
lating many ^qf. the ideas presented in this section. ^ ' ' 
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cient to have* alT children tak^ in^struction for each unit of the curricu- 

1\M instead of checking to see if som^ few children could test out> of 

/ 

instruction* Eliminating i^necessar)/ pre-testing jvould reduce the 



•pQount of time a^child woyld have to spend in a unit from say five to* 

■■ / \ • \ 

- seven. periods to three or' four periods, 

. Biut £h^t "^out the first-stage ■|)lacement test, 'the one in IPX 
Mathematics, that located the level of the pupi^ in the curriculum. We /; 
hav^ alre^idy stated' that once a pupil is in the curriculiam sequence, 
fvfrther testing with this first-stage test would be unnecessary Jbecause - , 

• we already have* the' instructionSll i^story of the stud^t at our disposal. 

\ ^ ^ ♦..Al- 

so,, the first-stage placement test is useful only for thos^ pupils for * 

^^^J^^hom we ha'^^ little or no information about cvfrxicular history, , ^ ^ 

^ There dre other- considerations here, however^ beside "just location in i 



a specif icj .curriculum. TTiis is jespecially true, in subject areas outside 
of arithmetic ♦ In reading for exanyle, pupils transferring into a 
school system from another system tfften have been instructed i:^ng a dif- 
ferent re^ading series • In this inst;ance we need to know the answer to 
two quei^taons before we can plaice and instruct the child. We need to - 



know the 



general reading level* (For example, we would like tp know 



whether the diiidi^can be put into the middle grpup of^the second > 



grade . ) 



But also, '.we need to know whether the particular i^iosyncrati^c 
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connections, content sequence, and\so on of the reading series we 
are. using have been learned by the pupil, Jf not, then even if we plaee 
/ the pupil at the pifoper reading level, -the pupil will have diffi>^ulty 
learning from the typ$ of instruction that we have to off^^. The IPI 



16. 



Mathem^id^.type placement .testing procedure does not test for 
this acquisition of th^ i^osyijcracte§ of a ^particular curriculum. An 
analogy mi^t help t.a clarify the point,.' We hire someone to perform 
a jpb on the basis of information §ibout the person's general level of 



ski/ll and knowledge. After we^hire the person, we give on-the-job- 
.troining to acquaiiit the person with th.e ^diosyncracies of the^ 



job that vere not acqfuired bejfore'being hared. * Simil'arly, 
if we know a pupil's general reading level we can place the puf)il in 



the reading, p'rogram, but what we often lack-is information about the 
kind of on-the-job-traini|jng the pupil needs to quickly acquire more 
advanced learning. 

/ ~ And what about these diagnostic^esting procedures? Are they 
ne"cessary and sufficient? In a truly adaptive and personalized instruc 
tional systejd, diagnosis for student,, lemming difficuj. ties wilP be a 
"continuous', on-going process. The super teadier will obtain this 
'information f^om interacting with 'the child aroiind(Jthe daily instruc- 
tional materials. But not all. teaS^iers are ^able to do this in an 
exceptional way. ^ • ^ . . ^ 

The->di^p^stic^ tests we ha^e discussed today do little to look 
at iprocess. That is, how the Idamer petforms the skill. Further, 

*^ 

they do .not assi'gn differential inrpprtance to the categories of errors 
detected. They simply identify errors. ^ ^ 1 

Errors in learning are often in need^ of interpretation in ligKt 
of the particular instructional program in which they occ©r. In some • 



instructionafv^equenCes, for exanqple, a highly proficient level of . * . ' 

performance is require4 in order to continue • In other^ program^ , ^ 

howeveT; instruction is so designed that it is spiral in nature • 

When this occurs, it is -often necessary only to have a very minimal 

leVfel of prolfici^ncy in order to proceed ^to new instruction because 

th^ concept -or skill to be learned will* be taught again and integrated 

into more' advanced leamifigs. * For eocample, those who have studied 
• ' • • ' 

statistical methods may rec^all the standard deviation. The meaning 

and value .of the standard deviation as a statistical index and concept. 

is one of the most' difficult to understand for the beginning student. 

Iti^ i^only after advanced'statistical topics are studied and after one 

us^ the standard deviation in practical problems, that one is able to 

come to "see' what it means". Mad the instructor insisted on complete 

^ / ^ , * , • ' ' ^ ■ . 

mastery df'this concept before proceeding to new material, then students 

would have been in grea,t difficulty ,^d perhaps would not have learned 

the concept at all. ' - 

Similar instances- occur in other subjects. In reading, for example 

one program* that illus^t^tes this point is called the New Primai^y- 

Grades Reading 'System (Beck- and Mitroff, 1972) and is being developed 

currently at the Learning Research and Development Center. ;The 

spiraliftg -nature of the curriculum can^be describee^ in this way (Beck,, 

1975): V ' ^ , ^ • 

In. a spiraling structure,, the child initially 
learns to decode oa a limited nxamber of 
important [letter/sound] poicrespondence;^ ; 



> 



/ 

/ 
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16 



then many /sentences and ''story paragraphs" ' 
containing words with those decodable Elements 

• are mad^ available to^ [the child] in connected 
text. AS the child re.^s with ^ai\ing through 

I, the known ^l^ments, the next loop in the spiral 
enlarges [and the child] is ii^troduced to new 
/ .elements, '^^e child continties to read extended- 
meaningful texts that incorporate the new 
elements with previovisly taught content, (pp. 21^1) 
. - • ^ ' k ^ ^ 

This curriculum is unlike the strict hierarchial structure implied 

'•• - ; \ ^ 

by IPX Mathematics, where in each prerequisite would need to be learned 
at a relatively hi^ level \of profixiency before moving to more advanced 
learning. Ks a consequeneef of the spiral nature, it is possible to 
^identify which specific learnings ar5 important to acquire at a higji 

degree* of initial proficiency" and which learnings need only a minimum 

* ^ ** 

initial level of proficiency because the child will encounter and f 

practice these learnings later in the curriculum. Also, by e>t^rtj,iiihg 

the relationship between the learning materials y the curricuJ^' sequence 

and the types of errors, it is possible to determine whicji' -pupil per- 

fontahce errors, are serious and which are not serious. Errors »that are 

not serious could either be remedied by a. few instrugtion^l comlnents^^^ .f 

by teacher or ignored entirely. , Thus, no formal remedial pre- 

sci^iption need bd written* and valuable instructional time on new content 

need not be lost. . . » . ^ * 

A little bit. of iAsight into this type of carefully designed pro?^ 

gram can be obtained from Figure 11. Instructional materials ' ' 

andVesources are carefully correlated to* th^ child's workbook. This ^ 

* * . ' * '\ * 

is important in this system' because each child) will b.e reading at a 

* / * 

different level and 'the. teacher *^wi 11 need^ to^ave readily available 

information about each lesson as .the t;eacher ''travels** or moves from 



child to child &r tutpring. Here we will focus on the prescription ^ 
an'd the *diagnos4^s aspects. • , 

•Within the 'child's workbook is a prescription form that lists* the 

'available instructional materials -for the specific lesson at.hand. 

' \* ' , * * 

This- allows* l^e teacher the opportunity to tailor the assignments to the 
pupils. In addition; the prescription' form shows the ^child what ard^ . 
some of the othe^ options available. These ^include games and. read- 

• ) 

along books'. Bac^ prescription form "advertises" these options to 
the child. Prescription theh includes not only what the teacher assigns 
but also what the child would like to^do. An fexampl^ of \a prescription 
form'is shown} in "Figure 12. 

Diagnosis occurs at two levels-rduring"- the lesson and Svt the 
completion of the lesson. At the bottom of s^ome of the workbook pages;, 
are lyotes to the* teacher suggest specirfic kinds (^f interac'^on 

\ ^ ■ , . • ■ - 

Between teacher and pupil with the instructional materials (se.e Figure 1 

. \ • ' . 5 ' ; ^ 

Th^se interactions provide opportunities ibr detection- and immediate 
correction of learning difficulties.- ^ . , 

At certain 'points in l^e vAJ^kbook short* tests called^ progress 
checks test formal mastery of key elements of content. The child'.s 
responses' to th^tasks on these short tests are analyzed for possible 
errors. E rigors ^ are not only classified as to type, but tfie teachejr's 
guijde indicates whether the. error is serious enough to delay advancegd 

instruction. Some errors are seriousi and the teacher has available a 

1 ' . 

book of alternative ways to teach the content since the '^mainstream 



ins'tructional materials^ wpren't effective. Other errors /ar§- less 
serious tod minor attention may be needed. These tyjj^s of- errors ^^^^ 
often self-borrecti^ng on the part of the learner because of the .spiral- . 
ing na^:iare of the curriculum. An illustration of 'this type of diag-^ 
nostic procedure is shown in Figure. 13. ' * ^ . ,\ 

' This exonj^^ is from an ^arly^ level of the redding , system* and shows 
attentioi\ to the processes the"^ child uses in decoding the.,printedVo^ds , 
Summary \ . ' , \ . 

Iri^ Nummary then, testiiig'palys a role in systems of instruction 
that are designed to adapt to, the characteristics of learner^. One 
.characteristic is the learner* s past level of general knowledge of- 
the sijbject or skills we would like to teach. Tests which provide 
information that allow the decision to be made about wh^re in the 
instructional sequence the Reamer is to begin in order to avoid 
repeating ''unnecessarily what is already learned and in order to en- 
counter readily attainable •new coals, can be called placemetit tests. 
We have examined the IPX Mathematics two-stage placement procedure as 
an exaniple of a placement tfest in an adaptive systqf^. Further, we - 
argued that such placement tests as these may nifc ]^ entirely necessary 

vand that they may not be sufficient. To be necessary, we have tcr answer 
/ # • ^ 

another question, namely, "What consequences wbuld result if we useii ^ 
the pl^ement test or if we didn^t use the placement test?". Sometimes 
instruction ^lus* /testing takes longer than instruction alone aridf thu^^ 
testing mi,^t be considered unnecessary, Ofher criteria might be con- 
sidei^ed also before a judgment about necessity would be made. To be 



siifficieAt one would have to ans,wer the ,question, "What other kinds 

^ of information woui'd be. needed before a placement decision can be * *^ 

** *• , * • ' ; 

made?" Here. ve\ argued that it is ^.often usefdl to know which <>f the 

program specific or program idiosyncratic conventions and learning 
mfethpds doesl the student know before we could place the pupil. Some 
piroils may, for example, read at the proper grade leve/l,ybut they* ' , *= 
mi^t need some on-ther- job-training to learn hdw tor learn from the - 
instructional system they will ilse in their new School • \ \ ' 

A second characteristic to be examined is the nature leaxn- 
ing activities^that best fit an ihdivi'dual ' s requiremep^fes and tffus max- 
imize the individual's chance of attaining the chosen goal,. Tests giving 

Jit ' 

some of ithis kind of information can be called diagnostic,** Cojtiputer- 
assisted testing and the Dade County arithmetic tests ^were used as 
examples. Thekey to both of these tests was their ability to identify 
pupi^ erjpors and match these errors with specific «remedial^ij^tructional 
activiti^s. However, both of th^se tended to gi^ little attention to 
the processes by whidi the pupil responded t&^e leai^ing material 
and tende'd to^weigja all errors with equal seriousness, >Another example 
was considered, one from the New ^rinja^ Grlofes Reading Sys'tem, ^^^^'this 
sy^tenknot ^ly are erijors classified and finked instructional 
activities,- but they are viewed in^the context of the pai^icular type 



of instructional system in whic^^^child is learning. That^is, the 
spiral i^ature of the learning seq^^fie i^^iken into account so thM 



not all errors are viewed as* being of equal seriousness nor do they all 



reqiiire elaborate remedial teaching. Some errors can be ignotred since 
they would be eme^ted to be overcome as t;he child progresses to* new. 
learning e5q)eriences* * ^ ' ^ . ^ 

In all. of this, then, the context^ of the instructional program 
shapes' the kinds^ of placement 'and diagnostic information that is 



required ^d,-'the^€^fore, the types of tagts that would be useful., 
Without an analysis o^ the kinds of inst^ii^tional decisions to be made 
in a given situation, ^isciassions about tests and testing po^ocedures 
tend to be ffuitless. , ' 

Not only does the test information need to pe laseful, bu-^ the - 
information should be useable as well. That is, testing should be 
designed into the instruction procB^ so that the information that is 
reqiiLred *chn be obtained easily and is available in a, form that is 
useable when a decision needs to be made. ' * - 

When viewed in this way; the distinction between testing and 
instruction becomes less distinct. The learner* can look toward testing 
as i^eedback about accomplishments and for# guidance toward chosen goals. 
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*Indicates a unit of instruction consisting of one or more instructional 
objectives. 



Figure 3* ' 

Example of curriculum layout for Individually Prescribed Instruction 

elementary mathematics 



Pqpil Information. Requirements • 
> An Adaptive Individualized 

■^ ' instruction ; |, 

/ - ♦ . ,\ ' ' } 

I. . Placement Information ^ 
^ —"Where should this pupil be located in the curricular se^quence 
to begin his instruction?" >. 
. Example :. 'Johnny should begin his studies at C-Le>*el Addition,. 
Skill 4. • 

^ Ilr! Diagnostic Information ^ ^ 

—"What are the cl^aracteri sties of the instruction that should 
/ be given this. student so that he will be able to master the 
. skill at which he was placed?" - ' 

* Examples : Sue should review those C-Level sfeills rel^d to 
regrouping before studying D-Level Subtraction", 
Skill 4. . \ 

Johnny regroups from hundreds to, tens but does not 
V. change the hundreds, digit accordingly. Review - 
, '■" regrouping sl^ls. ' ^ 

III. Evaluative Information ; / - 

—"Has the student acquired the skill(s) or> which he has been 

instructed?" , , ' V 

• . _ < ^ 

- Examples: Jim° has demonstriatefd mas'tery of. D-Level Addition, ■ 

" * » ' 

Skill 5 by getting >. 85 per cent of the items on the . 

CET c'orriBCt. 

Johnny has scored at or beyond the criterion level 
'. for all skills \n the C Subtraction unit, except for 
Skill 3. 30 
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Instructional proce^j flowchart for the I PI proccduijc (Adapted from Lindval^ Cox^ 
1970) 
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Figured- 

bjrrenf IPI ^TWing and Instructi(^al Procedure 
♦ (Modified fron Lindvall and' Cox, 1969.) " 



MATHEMATICS PLACEMENT PROFILE 



Name 
School 



^UvJ J^r^^uCh ) Date » Grade 

^.i^ujti^^ily Teacher ^^^^^21^ Room /o2> 



.Mathematics 
y Area 



Placement Level A-G 



B 



Placed 
at 
'\ Level 



Nutnerat ion/Place Value 



Addition/Subtraction 



Multiplicatio'n 



Division 




Fractions 



Money 



Time 



Systems of Measurement 



Geometry^ 



Applicationsx 



Figure 5 



Txanpl^ of Placement Profile for a hypothetical .student 
with respect to the mathematits curriculum of 
Individually Prescribed Instruction 
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.Figure 6 



Placement profile for a.hypothetical student. (Shaded boxes 
mean that the student has sufficient mastery of these 
instructional goals to proceed with a new 
instructional goal?) 
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Fig. '8 Hierarchies ofobjectivcj for an arithmetic unit in addition and subtraction. (Adaple(J 
from Ferguson, 1969.) , 
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*Table 2 
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PRESCRIPTION FORM. FOR ASSIGNING SPECIFIC LESSON 
MATERPALS IN A UNIT IN INDIVIDUALIZED MATHEMATICS* 



V 



-1 > - 



^*Table 2 has been removed because the publisher did not, grant ERIC reproduction 
permission. See MEASURING PUPIL ACHIEVEMENT AND APTITUDE, Second ^Edition, by 
C.-'Mauritz Lindvall and Atothony J. Nitkp © 1975 by Harcourt Brace Uovanovich. 
Inc. (p. 216). . ) . ' ^ 
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Based on FaK-c^uson,R.L. avj^d Hsu J.C.(I^7/). 
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1..01VI5ION FACT, 
ERROR ; 



3,SU&TRACT»0 
. ERROR 



5. NO ZERO JN 
ONE'S PLACE 



A- PRACTICE W/TH^ . 
FtASH GARDS, . 

A. COMPUTER- A^S'ST- 

.B. PRACT^^r^^(4TM 
, pp. t^s, 

'SERI.es, pp. 78- 
^79. 
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GROUp(sT0RY REMINDER 
Alerts tsfichor that child has 
prercquisl^ior next availablt 
group story. 



LESSON OVERVIEW 
Presents content ofjesson for' 
teacher. 



GAME ADVERTISEMENT. 
Reminds child of evailabta 



READ-ALONE 
^ADVEHTISEMENT 
Rcrfiinds child of avaitabla 
storybooks, ' ^ 



PROCpESS OlECK ' 
tndtvlctually administered assessment devici 
'which assists teacher In dotermlnlng 
v/facther student should mov0 on to next 
material. 




PRESCRIPTION 
Managoment devica Uiot enables 
tcftcher to mako variabla 
assignments, « ^ « 



CASSETTE RESPONSE PAGES 
Trigger audio lesson which 
presents' new content. Chlld^ 
responds on these pages whlfi 
listening to cassetta. 



INDEPENDENT SEATWORK 
PAGES 

Provlde^child with opportunity 
to practica new content while 
^maintaining previously taught 
content. 



. TEACHER TRAVELING NOTES 
Suggest relevant teacher-student fntar- 
action to traveling teacher on soma 
of student's independent pag^ » 
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Figure II Instructional resources in Levels 3 through lA. 
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4v2 continued on next page 
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DIAGNOSTIC TESTING [H THE NEW 
P.R1MARY'6R/ID£S R€AD!NG SYSTEM' 



